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Description 



Input device for a data processing system 



5 The present invention relates to an input device for a data 

processing system allowing convenient input of text or general 
control instructions. 



The input of text or general control instructions for 
10 controlling the mobile telephone plays a significant part in 
the use of data processing systems such as mobile radio units 
or mobile telephones. Text input for mobile telephones is 
currently mainly used when creating short messages to send via 
SMS (Short Message Service). In addition to the. aforementioned 
15 Short Message Service, a text input is also required for other 
services. These include for example a service for sending 
multimedia messages (Multimedia Messaging Service: MMS) , an e- 
mail service, a service for browsing the (mobile) Internet, 
for which a reference name (Uniform Resource Locator: URL) or 
20 a user name and password must frequently be input. It is also 
necessary to input characters or letters for managing mobile 
telephone books, in particular for inputting names and 
telephone numbers for telephone book entries into the mobile 



25 



30 



telephone . 



In addition to the input of text or numbers and characters, 
the input of control instructions, in particular when playing 
games on the mobile telephone, is becoming an increasingly 
important . part of mobile telephone use. For many games a 2D 
control is required for horizontal and vertical movements, ■ 
usually in the form of a 2 -way rocker switch, the keyboard of 
the mobile telephone or a mini joystick. 
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When building or designing modern mobile terminals, such as 
mobile telephones, developers are now faced with the problem 
that while, on the one hand, mobile terminals are expected to 

r 

5 "get smaller and smaller, suitable input devices, such as a 
keyboard, a joystick etc. must nevertheless still be provided 
to allow use of the aforementioned services or games. 

A user interface for inputting control instructions, in 

10 particular niimbers and characters, typically comprises a 

keyboard consisting of a three by four block of keys. The keys 
host several characters, that is, on one side the numbers "0" 
to "9" as well as the two special characters, and "#", 

while on the other side the letters, for which eight of the 

15 twelve keys are respectively allocated three to four letters. 
The respective letters or characters . can be selected either by 
pressing a single key several times, or using alternative 
methods, such as for example, the "T9". input method, which, 
with the aid of a dictionary, only displays possible words 

20 which make sense in the key sequence. The aforementioned 

options are convenient for the practised user and, for someone 
with a certain level of experience, also allow texts to be 
input quickly; however their use should not be regarded as 
particularly intuitive. 

25 - * ^ 

It is therefore the object of the present invention to create 
an intuitive and convenient way of inputting control 
instructions into a data processing system with a minimal 
technical outlay. 

30 

This task will be achieved by the subject-matter of the 
independent claims. Advantageous developments are the subject- 
matter of the subclaims. 
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All input device or input \mit for inputting control 
instructions into a data processing system first of all 
comprises a movement acquisition device for capturing 
^ momentary movement of a reference point of the input device 
(e.g. as explained below, on a base) and for outputting 
relevant movement data. The movement acquisition device is 
specially designed for capturing translative movement of the 
reference point. The input device also comprises a display 
- 10 device or a display with a first display field for displaying 
a field of control elements which is respectively allocated at 
least one specific control instruction. The display device 
can, for example, take the form of a Liquid Crystal Display 
(LCD) or an electroliaminescent display (using organic or 
15 inorganic semiconductors or electroluminescent colorings) . The 

first display field may comprise a section of the display 

i. 

device. The input device further comprises a control device 
for controlling the display device in such a way that the 
field of control elements is displaced in response to or in 

20 accordance with the movement data outputted by the movement 
acquisition device on the first display field. Finally, a 
selector device is used to select a control element from the 
field of control elements located in a specific selection 
segment of the first display field. This specific selection 

25 segment may be a display segment in the middle of the first 
display field for example, but it may also be any section 
marked by a symbol such as an arrow for example. To enable a 
user to recognize' which control element is presently located 
in the specific selection segment, the appropriate control 

30 element can be visibly activated, for example, using a 

distinctive border, by changing the color of the control 
element, or by setting the control element to flash etc. The 
selector device comprising a key as selection means in the 
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simplest case scenario for example allows the user to now 
select the control element in the selection segment, whereupon 
a control instruction allocated to this control element is 
carried out or an appropriate signal is output to the data 
5 processing device. With an input device, with which control 
elements on the display device or on the first display field 
can be displaced on the first display field as a function of 
the movement of the input device, it is advantageous that, on 
the one hand, no additional selection means such as a pen are 

10 required, but also because no cumbersome, large keys with 

complex key layouts have to be used. Rather, the input device 
can be moved in an easy and intuitive manner, particularly 
when it comes to translative movement, for example parallel to 
a table top, until the required control element in the 

15 specific selection segment on the first display field has been 
displaced for final selection. 

According to an advantageous embodiment, the field of control 
elements displayed on the first display field takes the form 

20 of a virtual keyboard, with which individual keys serving as 
control elements are allocated one or more characters . For 
example, the field of control elements may constitute control 
elements in the form of the keys of a QWERTY keyboard. .Since 
there is a relatively large number of keys on a QWERTY 

25 keyboard and it is not possible to have a clear view of all 
the keys on the first display field, it is advantageous to 
display only a section of this keyboard on the first display 
field. The user will then see the keyboard on the first 
display field as though through a window. In order to 

30 reinforce the user's impression that he is looking through a 
window, it is conceivable that the control device may control 
' the display on the first display field in such a way that the 
movement of the field of control elements is complementary to 
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the movement captured by the input device. That means, for 
example, that when the input device is moved to the left, the 
control element of the field of control elements is displaced 
to the right. This gives the user the impression that he is 
5 looking through the window of the first display field into a 
fixed view of the field of control elements, which, as 
mentioned above, may take the form of a keyboard. 

It is however also possible for the field of control elements 

10 to represent any user surface which features the specific 
elements or sections behind which there are control 
instructions or to which control instructions are allocated. 
Consequently, in addition to a keyboard, the field of control 
elements may also constitute a menu structure with various 

15 symbols or icons arranged on a neutral background which, when 
selected, can start up respective software applications 
programs for example. However, the field of control elements 
may also constitute an interface for a computer game, in which 
individual control elements are areas which the user must send 

20 into a goal, that is, the specific selection segment, by 
moving the input device, in order to adapt this control 
element in a particular way as. part of the game. By way of 
example, a control element may take the form of an object, 
such as a ball, which must have a particular color in the 

25 context of the game, so that by sending this ball into the 

specific selection segment and by selecting the ball, the user, 
can ''spray" it with the correct color. In terms of the 
representation of the field of control elements in the context 
of a game in particular, control elements can move. self- 

30 sufficiently or independently around the user interface, so 
that it may be the task of the user in the game for instance 
to "catch" this control element by moving the input device. 



r 
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In order to capture translative movement in particular, but 
also rotational movement, the movement acquisition device can 
comprise not only an optical or mechanical sensor but also an 
acceleration sensor. The mechanical sensor may take the form 
5 of a roller sensor for capturing the rolling movement of a 
ball on an interface. The acceleration sensor may in 
particular take the form of a longitudinal acceleration sensor 
for capturing the acceleration of a reference point of the 
input device,, with the movement of the input device or, to be 

10 more precise, of the reference point, the speed or position 
finally being calculated by temporal integration. The optical 
sensor can be specially designed for capturing certain 
patterns in the surroundings for determining the movement of 
the input device as a function of changes to the captured 

15 pattern. While the movement of the input device used to 
control the display on the first display field should 
preferably be along a plane which runs parallel to a 
protracted object such as a table, it is also conceivable, 
particularly when an acceleration sensor is used, that 

20 movements "in open space" may be captured by the input device 
in order to control the display device in this way or to 
displace the control elements on the first display element. 

According to a further advantageous embodiment, it is also 
25 possible for the input device to feature a movement 

acquisition device, in particular, for capturing rotational 
movement about an axis extending through the reference point 
and for outputting relevant- (second) movement data to the 
control device. This means that the control elements of the 
30 field of control elements on the first display field can be 
displaced as a function of the captured rotation. It is 
thereby also possible again for the control device to control 
the display on the first display field in such a way that the 
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field of control elements is shown as quasi fixed, with the 
-user viewing the field of control elements on the first 
display field as through a window. It is therefore possible 
that when the input device rotates about the reference point 
5 to the right, the display or view of the field of control 
elements on the first display field is rotated about the 
reference point to the left, thus maintaining the impression 
that the field of control elements is fixed. 

10 According to a further advantageous embodiment it is 

conceivable for not only one, but several control instructions 
to be allocated to one control element of the field of control 
elements. It is thus possible for the display device to 
feature a second display field which is configured so as to 

15 display the additional or the totality of those control 
instructions of the -control element, which is located 
precisely in the selection segment of the first display field. 
Take again the example of the view of a virtual keyboard 
through the field of control elements with which several 

20 nxambers or characters can be allocated to a particular key on 
the keyboard. For example, a virtual key is allocated both the 
number "6" and the In the second display field, 

representations or representative symbols of these control 
instructions (in this case for inputting numbers or 

25 characters) can now be displayed. 

If a second display field for displaying specific or all 
control instructions allocated to a control element is now 
available, . it is naturally also advantageous if the selector 
30 device comprises corresponding means for selecting the 

corresponding control instructions. In the simplest case, the 
selector device can again comprise a key, with the first 
control instruction being carried out by a short press of the 
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key, whilst the second control instruction is carried out with 
a long press of* the key. It is hereby also conceivable that 
the first control instruction is carried out by a single press 
and the second control instruction after short repeated 
5 presses. According to an advantageous development, however, 
the selector device comprises a plurality of selection means, 
of which one selection means is respectively allocated to a 
specific control instruction of the control instructions 
assigned to one control element. It is particularly 

10 advantageous if the respective selection means are positioned 
next to the second display field in such a way that a 
respective selection means is located next to a representation 
(e.g. a symbol) of an allocated control instruction. This 
enables the user of the input device to input characters or 

15 text quickly and intuitively, since, not only does he no 

longer have to search for the required key on a key hosting 
two or more letters, but he can also select the correct 
control instruction intuitively by applying the relevant 
selection means, so-called "soft keys", in addition to the 

20 representations of possible control instructions. 

Specially developed for inputting text, the display device 
comprises a third display field designed to display the most 
recently selected control instructions. This means that when 
25 text is input the most recently selected numbers, characters 
or symbols will be displayed in the third display field so 
that the user can view the text as it is written and make^ 
quick corrections as required. 

30 According to a further aspect of the invention, a data 

processing system is created with an input device as described 
above. The data processing system can, in particular, take the 
form of a portable data processing system, such as a mobile 
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radio unit or a mobile telephone for example, but also a 
portable computer such as a PDA (Personal Digital Assistant) 
or organizer. An input device, though, may also come in the 
form of a separate module, which is connected to the data 
5 processing system via a wireless data link such as a radio 
circuit or infrared circuit but also a wired circuit. 

When the input device is designed as a separate modular 
component in particular, it can also be used to control any 
10 electric device, thereby allowing the input device to cover a 
wide range of uses . 

Preferred embodiments of the present invention are described 
in further detail below with reference to the appended 
15 diagrams, in which; 

1 shows a side view of a data processing system in 
the form of a mobile telephone in accordance with a 
preferred embodiment; 

2 shows a plan view of the mobile telephone shown in 
Figure 1 to indicate how text is input using a 
virtual keyboard; 

3 shows a diagram of the display device of the mobile 
telephone illustrated in Figure 1 in accordance 
with a further embodiment; 

4 shows a plan view of the mobile telephone shown in 
Figure 1 to illustrate how the method according to 
the invention is used in the context of a game. 



Figure 

20 

Figure 



25 Figure 



Figure 
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Reference is now made to Figure 1, in which a data processing 
system in accordance with a preferred design of the invention 
is shown. The data processing system takes the form of a 
mobile telephone MT with a built-in input device in accordance 
5 with the embodiment of the invention. Firstly, the mobile 
telephone features a display device DSP which may take the 
form of a Liquid Crystal Display, for example. The mobile 
telephone also comprises the two control keys, SKI and SK2, 
which are more clearly illustrated in Figure 2. Below, or in 

10 Figure 1 there is a keyboard TAS next to control keys SKI and 
SK2 consisting of four rows and -three columns of keys. The 
underside of the mobile telephone MT has a movement 
acquisition device in the form of an optical sensor designed 
to capture the translative movement of the mobile telephone 
- 15 MT, or more precisely, of its reference point, such as the tip 
of the arrow PF in Figure 2 or cross ZM in Figure 4, on or 
across a flat surface such as a table for example. The optical 
sensor/ SEN can capture the grain of a table as a pattern and 
correspondingly derive a movement of the mobile telephone MT 

20 from the movement or change in the pattern, then forward 
relevant movement data to a control device ST, which will 
finally control display device DSP. 

r 

Reference is now made to Figure 2 , in which a plan view of the 
25 mobile telephone MT just mentioned is displayed. As 

illustrated more clearly in the diagram, mobile telephone MT 
viewed from top to bottom comprises the display DSP, the two 
control keys or soft keys SKI and SK2 and the keyboard TAS. 

30 An essential possible use of the present invention is now to 
input text which can be sent to another mobile telephone by 
SMS (Short Message Service) or MMS (Multimedia Messaging 
Service) for example. With the conventional system, this text 
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is input using the keys of the keyboard TAS, with each key 
being respectively allocated a complex scheme of several 
characters which is barely comprehensible, particularly to the 
unpractised user, and does not allow intuitive text input. 
5 According to the present invention, however, text input is 
easier and more intuitive. With this aim in mind, a display 
field (or first display field) is provided on the display DSP, 
on which a field of control elements is arranged in the form 
of a virtual keyboard VT. This virtual keyboard may, for 

10 example, take the form of a' conventional QWERTY keyboard. The 
keyboard will comprise the control device ST described in 
Figure 1 and is displayed on the display device DSP. As is 
clear in the background of the mobile telephone MT, the 
virtual keyboard VT would comprise four rows of keys which 

15 nevertheless will not fit on the rather small display field of 
a mobile telephone MT if a clear and easy-to-read view is 
required. In order to achieve this clear view, only a section 
of the virtual keyboard with the respective keys as control 
elements is now shown on the display field of the display 

20 device DSP. The display field takes the form of a type of 

window through which the virtual keyboard VT can be viewed. If 
a user now wishes to input a text using this virtual keyboard 
VT, for example for a short message, he will now attempt to 
move the desired key into the display field of the display 

25 device DSP, namely into a specific selection segment from 

which the key can then be selected and an allocated character 
input. As illustrated in Figure 2, an arrow PF with its tip 
marking the specific selection segment serves to indicate the 
specific selected area. The arrow PF can be provided on a 

30 transparent display cover for example, but it can also be 

integrated in the view on the display field using software. If 
the PF arrow is not used, it is also possible simply to define 
the specific selected section in the centre of the display 
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field. It goes without saying that there are also other 
suitable ways of marking sections in the display field in 
order to set these specific selection segments, such as marks 
in the corner of the display field or other types of marking. 
5 As illustrated in the figure, the letter "G" is currently 
located in the selection segment and represents the active 
element or control element HE. This active element HE or this 
element HE at the focal point can be visibly activated for a 
better contrast between it and non-active elements by 

10 highlighting it in bold for example (compare with Figure 2), 
by enlarging it, by highlighting it in color or inverting it, 
putting a border around it, by setting it to flash for a 
specific period, etc. Should the user now wish to select this 
active element HE or to input the character allocated to this 

15 element for a text, he must select this element or confirm 
selection of this element. In order to do this, the mobile 
telephone comprises the SKI or SK2 keys which can be used as 
selection means. It is assiomed for the current example that 
the SKI key serves to select or confirm active elements. If 

20 the user now presses the SKI key in the condition illustrated 
in Figure 2, the character G is input. 

Should the user now wish to input another character, he must 
move or displace the window shown by the display field in 

25 relation to the virtual keyboard VT. It is assumed that the 
user wishes to select a non-active element NE, the element 
representing the letter "A" for example, in order to input the 
letter "A" into his text. For this purpose, he now moves his 
. mobile telephone MT to the left in the figure. This movement 

30 is now captured by the optical sensor SEN and the appropriate 
movement data will now be forwarded to the control device ST. 
This control device ST is now designed in such a way that it 
controls the display device DSP in such a way that the content 
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of the display field is displaced to complement the captured 
direction oiE movement. In the case just described, this means 
that when a movement of the mobile telephone MT to the left is 
captured, the display on the display field is displaced to the 
5 right . This means that the respective keys of the virtual 
keyboard VT move from left to right so that the user has the 
impression that the virtual keyboard is fixed, while only a 
small "window" section of the virtual keyboard VT can be 
viewed by moving the mobile telephone. 

10 

Should the user wish to input additional characters, he only 
needs to move the mobile telephone MT in such a way that the 
desired control element or ^the key with the desired letter 
appears in the display field of the display device DSP and, to 
15 be more precise, in the specific selection segment, so that 
this key becomes the active element HE, whereupon the user 
then needs only confirm this selection using the SKI key in 
order to input the appropriate letter. 

20 Reference is now made to Figure 3 , in which a display device 
DSP with a number of display fields for convenient text input 
is displayed in accordance with an additional design. The 
display device DSPl, which can be arranged in the mobile 
telephone illustrated in Figure 2 for example, instead of 

25 display device DS, comprises a first display field AZl in 

which a virtual keyboard VT corresponding to the display field 
of the display device DSP in Figure 2 is shown. Due to the now 
reduced display options however, only two lines of the virtual 
keyboard are shown in this example, allowing a clear view and 

30 easy selection of keys. By way of contrast to the display DSP 
of Figure 2, there is no arrow PF to mark out the specific 
selection segment for display device DSPl or the first display 
field AZl. Rather in this instance, the specific selection 



PCT/EP2004/051945 / 2003P13545WOUS 

14 

segment is set in the middle of the first display field AZl. 
The centre of the first display field AZl also serves as a 
reference point for the mobile telephone MT. As illustrated in 
Figure 3, a virtual key is currently located in the specific 
5 selection segment which has (visibly) been allocated the 
number "6". This virtual key thus represents the active 
element HE, the control instruction of which can be selected 
if it is to be carried out. By way of contrast to the 
embodiment for text input described in Figure 2 , in which one 

10 control instruction is allocated to one virtual key, a 

plurality of control instructions are allocated to one virtual 
key of the. virtual keyboard VT with the design illustrated in 
Figure 3, In particular, this should enable a user to use the 
virtual keyboard like the familiar typewriter keyboard or 

15 computer keyboard. With these types of keyboards, one key 
hosts several control instructions so that when pressing 
specific control keys, again the "Shift" key together with the 
actual key, another control instruction can be input as though 
the respective control key had not been pressed. In the 

20 present example illustrated in Figure 3, the number key "6" 

should host two control instructions or characters, namely the 
number "6" and the character The possible characters 

n. 

offered by the active element HE are displayed in a second 
display field AZ2, where the first control instruction SAl (or 

25 the symbol representing it) in this case the number "6", and 
the second control instruction SA2 (or the symbol representing 
it) in this case the character are shown next to each 

other on the bottom row of the third display field. Should a 
user now wish to select or input one of the two characters as 

30 text, he only needs to press the control keys next to the 

respective control instructions SAl and SA2 or soft keys SKI 
or SK2 . This directly adjacent arrangement of the control keys 
SKI and SK2 under the available control instructions or 
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characters, SAl and SA2 , enables the user to use the mobile 
telephone intuitively, particularly when inputting characters 
for writing a text. 

5 It should further be noted here that., in particular "when 

inputting letters for which there is the option of upper or 
lower case, .when typing one of these letters (when bringing 
the letter into the specific selection segment) , the upper 
case letter for example can be displayed as a control 

10 instruction SAl, while the lower case letter is displayed as a 
control instruction SA2 . In this way, simple and intuitive use 
can be achieved, with which a user can bring their knowledge 
of a conventional typewriter keyboard or computer keyboard to 
bear. In particular when using the two control keys or soft 

15 keys SKI and SK2, the known "Shift" function of a computer 

keyboard (changing the input by pressing down the "Shift" key) 
can be implemented. 

In order to make inputting text even more convenient, the 
20 display device DSPl also comprises a third display field AZ3 , 
in which the most recently inputted control instructions or 
characters are shown as drafted text ET,. The user therefore 
has an overview of which characters or words he has input 
recently and can also make corrections if necessary. 

25 

A control element or a virtual key can again be brought into 
the specific selection segment by moving the input device as • 
explained in detail in Figure 2 for example. 

30 Reference is now made to Figure 4, in which a mobile telephone 
MT is again displayed, which largely corresponds to the mobile 
telephone MT shown in Figure 2, only in this case, a section 

• * 

of a computer game VS interface is shown on a -display DSP2 
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instead of a virtual keyboard for inputting text. In 
accordance with the display of the virtual keyboard VT 
according to the explanation in Figure 2, a type of window is 
once again shown on the game interface in the display field of 
5 the display device DSP2 . The display device DSP2 is controlled 
in this way by a control device (not shown) such that the game 
interface or graphics appear as quasi fixed, an effect 
achieved by displacing the game interface section on the 
display DSP2 in a way which complements the movement of the 

10 mobile telephone. This means that if the mobile telephone is 
moved to the left, the display or section of the game 
interface in the display device DSP2 is displaced to the 
right. In this way, by moving the mobile telephone MT on a 
level, the user can bring specific objects on the game 

15 interface which serve here as control elements (and should be 
pressed or selected as for the input of control instructions 
explained above) into the specific selection segment which is 
marked on the display device DSP2 by the cross ZM. For 
example, an object OB can be brought to the cross ZM by moving 

20 the mobile telephone MT up and to the right so that by then 
pressing the control key SKI in the context of the present 
game, a shot can be fired at the object. It is also 
conceivable that the objects serving as* control elements are 
not fixed on the game interface VS, but are mobile. Skill and 

25 fast reflexes are therefore also required for the game if the 
user is to bring the moving object to the cross by moving the 
mobile telephone, 

A further advantage of the invention is that, since it can be 
30 used for any kind of input, the conventional keyboard may be 
dispensed with altogether as an input device, so it is also 
possible to develop mobile telephones without keyboards which 
can be produced cost-effectively and offer greater design 
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freedom than devices without the appropriate input options but 
with a keyboard. 

In summary, it could be said, then, that building a movement 
5 sensor into an input device or a complete data processing 

system for capturing the movement of the input device or data 
processing system as well as for controlling the display in 
response to the captured movement allows simple and intuitive 
use, with a minimum of technical expenditure involved in the 
10 creation of the input device or data processing system as no 
additional modes of input such as "Navi keys" or "joysticks" 
are required. 



